v33.0: Protocol Buffers v33.0

Compare Source

Announcements

• Protobuf News may include additional announcements or pre-announcements for upcoming changes.

Bazel

• Feat: update bazel central registry publish workflow (#​23465) (#​23913) (d5217fd)
• Add target_compatible_with parameter to proto_toolchain in Bazel rules (#​22429) (30d2332)
• Bazel: add missing rules_cc loads (#​23584) (d98e2ef)

Compiler

• Disable symbol visibility enforcement by default in C++ runtime (ae308fc)
• Ship all option dependencies to plugins along with regular ones. (abeb130)

C++

• Avoid calling deprecated arena-enabled constructors in arena.h. (813a7ef)
• Add a macro to make RepeatedField(Arena*) constructor private in a future release. (768db14)
• Add a macro to make Map(Arena*) constructor private in a future release. (543a17f)
• Optimize ReadPackedVarint (3d94d83)
• Add a macro to make RepeatedPtrField(Arena*) constructor private in a future release (6422b9d)
• Add IsEmpty() function to reflection. (b64e490)
• Refactor RuntimeAssertInBounds to remove repeated logic and make Get/Mutable easier to read. (2f270c4)
• Disable symbol visibility enforcement by default in C++ runtime (ae308fc)
• Fix a bug in the main C++ JSON parser/serializer camelcasing of certain non-style-compliant names incorrectly, in a way that would prevent it from interoperating with any other implementation on those fields. (e25e267)
• Fail early for messages with more than 65k fields. (90824aa)
• Add option to C++ JSON Parser/Serializer to allow customers to affirmatively disable legacy bug-compatibilty behaviors. (6ea1640)
• Fix mishandling on JSON serialization of Timestamp with invalid negative and too-large nanos value. (a959f27)
• Preserve features in type resolver (c7030f4)
• Add a DCHECK that ArenaStringPtr::Set(char*, Arena*) is not called with (95b1763)

Java

Restored compatibility of runtime with gencode created with protoc <3.21

With this release, compatibility of the runtime with older gencode down to 3.0.0 is restored, compared to the previous support minimum of gencode created with 3.22+. Note that it is still strongly recommended to regenerate your gencode with a newer protoc and to avoid using gencode which was created with an old protoc.

Generated code from this range is covered by CVE-2022-3171 and is potentially vulnerable to a Denial of Service risk.

JavaProto 4.x previously dropped compatibility with the potentially vulnerable generated code, having the behavior of:

• The vulnerable generated code was source-incompatible with new runtime (would not compile when built from source)
• The vulnerable generated code was ABI-incompatible with new runtime (when using a .class file compiled against old runtime, a NoSuchMethodException would be thrown at parse time).

Starting with this release:

• The vulnerable generated code is now source-compatible (will compile).
• The first time each potentially vulnerable type is parsed, an error message will be logged noting that potentially vulnerable generated code is in use and the name of the corresponding type.
• Environment variables may be set to either throw an exception instead (-Dcom.google.protobuf.error_on_unsafe_pre22_gencode) or to entirely silence the logged messages (-Dcom.google.protobuf.use_unsafe_pre22_gencode)

This change was made based on community feedback regarding the difficulty in identifying and quickly remediating stale gencode in their transitive dependencies weighed against a careful evaluation of the realistic risk exposure of DoS (with no risk of other concerns including information leak or RCE).

We strongly recommend that any users who observe the log messages to regenerate the corresponding code with a newer protoc. We recommend that any security-conscious services opt into the error_on_unsafe_pre22_gencode behavior to preclude any risk of a Denial of Service surface area being exposed.

A future 4.x release may flip the default behavior to error by default as a measure to further help the ecosystem avoid the Denial of Service risks, while still maintaining the ability to opt into continuing to use insecure gencode for users who are parsing trusted inputs and where the difficulty of regenerating is high.

Changes

• Switch the pre22 warning to use CopyOnWriteArraySet. (#​23969) (e55224c)
• Expose helpers for checking if messages and enums are nested. (8de4002)
• Fix a bug calculating the file name in the absense of directories. (c4ff7a6)
• Clarify the public APIs of GeneratorNames helpers. (537ac35)
• Expose helpers to predict generated class names in java. (eba6df2)
• Deprecate ClassName methods in favor of new QualifiedClassName ones. (ca4fb2f)
• Restore the 3-argument internalBuildGeneratedFileFrom. (4376591)
• Fix large java enums not being honored on lite runtime. (a995803)
• Slightly relax Java Poison Pill on prerelease versions (-rc1, -dev, etc). (7b0bee3)
• Avoid boxing/unboxing varint, fixed32, and fixed64 fields in UnknownFieldSet.Field (810272f)
• Readd new*List() methods on GeneratedMessageV3. (badaf41)
• Add Values.of(Map<String, Value> values). (c518f25)
• Fix handling of optional dependencies in java generator. (8d51e34)
• Restore ABI compatibility for extension methods which was previously (knowingly) broken with 4.x: 94a2a44 (ea33ae8)
• Restore Protobuf Java extension modifiers in gencode that were previously removed in 7bff169 (f2257f5)
• Ship all option dependencies to plugins along with regular ones. (abeb130)
• Optimize redaction state calculation (e05db5c)
• Add isPlaceholder() accessors to file, message, and enum descriptors (f978ec2)
• Improve Java gencode static initialization to avoid unnecessary temporaries again (745e15b)
• Improve Java gencode static initialization to avoid unnecessary temporaries (b68b673)
• Remove protobuf-util usages of guava except annotations. (5768acd)
• Restore compatibility of runtime with pre-3.22.x gencode impacted by CVE-2022-3171 (7c51e5b)
• Expose an iterator for GeneratedMessage.ExtendableMessage.extensions (b25d39e)

Rust

• Change Rust prelude to bring in traits as _ (c3f7e8d)
• Make message Muts Send (8bff944)
• See also UPB changes below, which may affect Rust.

Python

• Publish s390x wheels for Python/upb. (56b2b89)
• Fix a crash that happens during shutdown due to looking up modules in the cache (d57d270)
• Add construction support for repeated Timestamp/Duration/Struct/ListValue. (5f6c013)
• Fix handling of repeated extension fields in PyProto JSON (07ef676)
• Fixed a parser bug where closed enums are parsed incorrectly for non-repeated extensions. (c36f728)
• Fixed mypy errors by setting __slots__ to empty in .pyi files. (38ca2d3)
• Raise warnings for float_precision from python json_format. (4659cd7)
• Raise warnings when assign bool to int/enum field in Python Proto. This will turn into error in 34.0 release. (4ee55d7)

PHP

• Fix(php): php errors on repeated field (#​23372) (6fee29b)

UPB (Python/PHP/Ruby C-Extension)

• Fixed a parser bug where closed enums are parsed incorrectly for non-repeated extensions. (c36f728)

Other

• Update token for BCR release to reuse existing BOT_ACCESS_TOKEN used for staleness_refresh.yml and update_php_repo.yml (#​23925) (dcace2f)
• Use the 'better' JSON parser on the conformance suite harness. (4b4e405)
• Add JSON conformance test that a single value provided for a repeated field should parse fail. (9806994)
• Add conformance test cases for malformed nanos fields on Durations and Timestamps. (a6bdd0a)

v32.1: Protocol Buffers v32.1

Compare Source

Announcements

• Protobuf News may include additional announcements or pre-announcements for upcoming changes.

Compiler

• Ship all option dependencies to plugins along with regular ones. (34d6c85)
• Unify plugin and built-in generators to use request/response interface (b98f6ee)
• Disable symbol visibility enforcement by default in C++ runtime (aad0daa)

C++

• Disable symbol visibility enforcement by default in C++ runtime (aad0daa)

Java

• Fix handling of optional dependencies in java generator. (892e0d5)
• Restore Protobuf Java extension modifiers in gencode that were previously removed in 7bff169 (4a18be6)
• Restore ABI compatibility for extension methods which was previously (knowingly) broken with 4.x: 94a2a44 (501f4a5)
• Cherrypick test improvements (d365736)
• Fix handling of optional dependencies in java generator. (9325480)
• Ship all option dependencies to plugins along with regular ones. (34d6c85)
• Unify plugin and built-in generators to use request/response interface (b98f6ee)

Csharp

• Regenerate stale files (299774c)

PHP

• Fix: remove provide from composer.json (bc5f303)

v32.0: Protocol Buffers v32.0

Compare Source

Announcements

• Protobuf News may include additional announcements or pre-announcements for upcoming changes.

Bazel

• Migrates some Java test protos using java_features.proto to edition 2024 (6f4a990)
• Add generated message reflection unittest for import option and option_deps test proto in edition 2024. (c51df73)
• Replace the usage of cc_info.debug_context with _debug_context (776c5f2)
• Generate .pyi files in py_proto_library (#​10366) (#​21567) (e3e56c7)
• Introduce denylisted_protos as a preferred replacement for blacklisted_protos attribute. (795ab9d)
• Use native.proto_library for Bazel 7 and explicitly error for Bazel 6 which is incompatible and out of support. (da0077e)
• Require ProtoInfo provider instead of proto_library rule for bazel cc_proto_library deps. (639f1c9)

Compiler

• Strip extensions from option imports that are known in CollectExtensions due to polluted pool from protoc parse when used with protoc full + java built in generator. (ef3f9ca)
• Deprecate google.protobuf.Method.syntax and google.protobuf.Method.edition (9ec241e)
• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Ban import weak and weak field option in edition 2024 in protoc (parser and c++ runtime). (a2a0511)

C++

• Strip extensions from option imports that are known in CollectExtensions due to polluted pool from protoc parse when used with protoc full + java built in generator. (ef3f9ca)
• Manually migrate top-level protobuf unittest protos from edition 2023 to edition 2024. (7359f75)
• Add generated message reflection unittest for import option and option_deps test proto in edition 2024. (c51df73)
• Remove the flag requirement for Bazel+MSVC users. (c6ba697)
• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Cast GetCachedTID() to unsigned to prevent left-shifting a negative number. (3e935cf)
• Update comment at the top of message.h and message_lite.h to document that it should only be extended by gencode and not user code. (6a6ba52)
• Treat warnings encountered in chromium builds as errors. (21c3c53)
• Ban import weak and weak field option in edition 2024 in protoc (parser and c++ runtime). (a2a0511)

Java

• Strip extensions from option imports that are known in CollectExtensions due to polluted pool from protoc parse when used with protoc full + java built in generator. (ef3f9ca)
• Remove CollectExtensions check banning unknown custom options since unknown custom options are now expected when using import option and option_deps which exclude the options from the "builder" pool (aka "import" pool). (694eedd)
• Manually migrate top-level protobuf unittest protos from edition 2023 to edition 2024. (7359f75)
• Migrates some Java test protos using java_features.proto to edition 2024 (6f4a990)
• Restore compatibility of runtime with pre-3.22.x gencode impacted by CVE-2022-3171 (adf556f)
• Update our compiled_edition_default's maximum_edition to 2024 (#​22870) (6216ae4)
• Restore the long-deprecated static functions on TextFormat. (5777d3b)
• Add Kotlin class name helpers to names.h (527b2ab)
• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Update Java gencode base class documentation to clarify that it is not supported to extend them. (c3177fb)
• Add a FieldMaskUtil#trim overload that accepts TrimOptions and allows retaining unset primitive field state. (84c5b63)

Csharp

• Update staleness (0014173)
• Manually migrate top-level protobuf unittest protos from edition 2023 to edition 2024. (7359f75)
• Update our compiled_edition_default's maximum_edition to 2024 (#​22870) (6216ae4)
• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Include also ARM build of protoc in nuget package (#​21568) (c2b4040)
• Improve C# handling of Any JSON serialization/deserialization (dc4e429)

Objective-C

• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)

Rust

• Rust: remove DEP_UPB_VERSION check in codegen crate (#​22764) (6f6012a)
• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Update Rust generator to output minidescriptors instead of C minitables (1b4b5fc)
• Add [clear_and_]parse_dont_enforce_required() to Rust protobuf. (e2fd7a0)
• Add #[non_exhaustive] on the oneof-case enum (aba2075)
• Impl Clone for RepeatedIter (aca1ed5)
• See also UPB changes below, which may affect Rust.

Python

• Strip extensions from option imports that are known in CollectExtensions due to polluted pool from protoc parse when used with protoc full + java built in generator. (ef3f9ca)
• Manually migrate top-level protobuf unittest protos from edition 2023 to edition 2024. (7359f75)
• Raise warnings for float_precision from python json_format. (#​23042) (1a7e012)
• Raise warnings when assign bool to int/enum (#​23030) (0b25f7b)
• Update python edition default maximum edition to 2024 (#​22889) (72abf95)
• Make protobuf codebase compatible with --incompatible_config_setting_private_default_visibility (#​22745) (5e2838e)
• Add Python deprecation warnings for Descriptor Label. (64a76e6)
• Updating setuptools to patch CVE-2025-47273 (#​22094) (508aba1)
• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Extend gencode compatibility support back to 3.20.0 (1af7fd4)
• Change proto_api work with custom pool for upb and pure python. (49d9e2d)
• Python pyi print "import datetime" for Duration/Timestamp field (f59b84a)
• Add reference leak check to Python well_known_types_test. Fix two refleak bugs. (e5f9ab4)
• Add reference leak check to Python timestamp_test and duration_test. Fix a refleak bug when assign datetime/duration to Timestamp/Duration (e004c8b)
• Add recursion depth limits to pure python (17838be)
• Remove calls to Label within Protobuf Python. (f69180a)
• Change Python .pyi stubs to generated _Optional[] for bool fields same with (6972464)
• Remove internal/api_implementation.Version() (cbad456)
• Fix python proto_api to work with messages that required fields are not set. (f63ed55)
• Fix python upb crashes on map/repeated reference stub destructor (4274909)
• Mark Py JSON float_precision deprecated. (727a8ed)

PHP

• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Fix(php): use count instead of ->count() to avoid bug in c-extension (9fbce62)
• [php][compiler][ext] - Add missing has* methods and other well known types (#​20636) (01a7429)
• Fix PHP 8.4 deprecation in GPBDecodeException (#​21232) (676666e)

PHP C-Extension

• Update our compiled_edition_default's maximum_edition to 2024 (#​22870) (6216ae4)
• Change 'getLabel is deprecated' to E_USER_DEPRECATED (158d8ac)
• [php][compiler][ext] - Add missing has* methods and other well known types (#​20636) (01a7429)
• See also UPB changes below, which may affect PHP C-Extension.

Ruby

• Make protobuf codebase compatible with --incompatible_config_setting_private_default_visibility (#​22745) (5e2838e)
• Enable edition 2024 support in protoc and language generators for cpp, hpb, java, kotlin, objectivec, php, python, pyi, rust. (26843b3)
• Fix silent failure of rb_test rules to run test (#​21733) (4f74764)

Ruby C-Extension

• Update our compiled_edition_default's maximum_edition to 2024 (#​22870) (6216ae4)
• Removed wrap_memcpy.c compatibility shim for pre-2.14 glibc (4ba9733)
• See also UPB changes below, which may affect Ruby C-Extension.

UPB (Python/PHP/Ruby C-Extension)

• Update our compiled_edition_default's maximum_edition to 2024 (#​22870) (6216ae4)
• Make protobuf codebase compatible with --incompatible_config_setting_private_default_visibility (#​22745) (5e2838e)
• Add upb_Message_SetExtensionMessage as a helper for setting a extension field that is a message. This is the extension equivalent of upb_Message_SetBaseFieldMessage. (f15d28a)

Other

• Update github major version tags to be formatted v..- for clarity (e001d57)
• Upgrade Abseil dependency to 2025051.1 (ee68ed1)
• Patch rules_ruby to apply neverlink = True to the jars rule (#​21416) (88e11bd)

v31.1: Protocol Buffers v31.1

Compare Source

Announcements

• Protobuf News may include additional announcements or pre-announcements for upcoming changes.

Compiler

• Support allowing late injection of language feature set defaults from FeatureSet extensions while getting feature set extension values. (3419598)

C++

• Support allowing late injection of language feature set defaults from FeatureSet extensions while getting feature set extension values. (3419598)

Java

• Add missing copts attribute (#​21982) (bec5b5a)
• Support allowing late injection of language feature set defaults from FeatureSet extensions while getting feature set extension values. (3419598)

Python

• Support allowing late injection of language feature set defaults from FeatureSet extensions while getting feature set extension values. (3419598)
• Python pyi print "import datetime" for Duration/Timestamp field (#​21885) (0fe099a)
• Add recursion depth limits to pure python (a3921fb)

Other

• Fix cmake staleness test (96a9ef6)

v31.0: Protocol Buffers v31.0

Compare Source

Announcements

• Protobuf News may include additional announcements or pre-announcements for upcoming changes.

Bazel

• Loosen py_proto_library check to be on the import path instead of full directory (i.e. excluding external/module-name prefix). (a4be867)

Compiler

• Add support for import option for protoc.(9901db6)
• Add notices.h with information about our dependencies' licenses and add --notices flag to protoc to print the contents of that file. (7a26486)
• Move upb minitable code generator into protoc (dce6b0f)
• Upgrade abseil-cpp to 2025012 and use @​com_google_absl -> @​abseil-cpp and com_google_googletest -> @​googletest canonical BCR names. (ba6b54d)

C++

• Remove fast-path check for non-clang compilers in MessageCreator. (aa5410d)
• Add missing include. (d390631)
• Add weak attribute to GetClassData to speed up clang builds. (d896480)
• Add nontemporal software prefetcher to repeated ptr field dtor to improve performance. (73f3469)
• Warn on unused RepeatedPtrField. (683e9d2)
• Add notices.h with information about our dependencies' licenses and add --notices flag to protoc to print the contents of that file. (7a26486)
• Fix a bug in handling of implicit-presence string_view fields. (bd70a7c)
• Control bounds checks via BUILD flags. (d21e8ef)
• Upgrade abseil-cpp to 2025012 and use @​com_google_absl -> @​abseil-cpp and com_google_googletest -> @​googletest canonical BCR names. (ba6b54d)
• Create hardened versions of Get and Mutable for repeated_field. (ffade4a)

Java

• Add weak attribute to GetClassData to speed up clang builds. (d896480)
• Use ProtobufToStringOutput to control the output format of AbstractMessage.Builder.toString. (f5cb162)
• Implement Protobuf Java Immutable API nest_in_file_class feature for Edition 2024. (0416c3e)
• Introduce a Generated annotation to eventually replace javax.annotation.Generated (31e57fc)
• Add volatile to featuresResolved (9e03ca5)
• Fix Java concurrency issue in feature resolution for old <=3.25.x gencode using lazy feature resolution. (fafb0fd)
• Remove Java runtime classes from kotlin release. (079be27)
• Split maven dependencies into dev vs local (#​20549) (e045fc6)
• Improve error messaging when detecting and erroring out on integer overflow of byte count limit variables. (097fdb8)

Kotlin

• Remove Java runtime classes from kotlin release. (079be27)

Csharp

• Remove "experimental API" warnings from members in the .NET protobuf runtime. (afea52f)
• Improve performace of repeated packed fixedSize fields (#​19667) (85507b9)

Objective-C

• [ObjC] Deprecate GPBFieldDescriptor.isOptional. (86ab252)
• [ObjC] Raise the library version and enable new generated code. (a639cf8)

Rust

• Cherry-pick Rust fix to 31.x (#​21617) (01b42bb)
• Add upb_Map_GetMutable API to upb (dd5bf5e)
• See also UPB changes below, which may affect Rust.

Python

• Update GetCurrentTime to use datetime.datetime.now (01b154c)
• Make Py JSON float_precision apply to both float and double fields. (5b54ee3)
• -Add '+' and '-' annotations for Timestamp and Duration in Python (fff783e)
• Bug fix for FieldMask.MergeFrom() with unset fields. (1c87ac3)
• Make python text_format able to skip unknown fields for repeated messages (dcafca2)
• Fix segment fault for UPB Pyhon 'in' method of empty repeated extensions (da04261)
• Fix upb to escape DefinitelyNeedsEscape (like " and ') for bytes field (b234305)
• Check with fallback descriptorDB for FindExtensionByNumber()/FindAllExtensions in UPB python pool. (9fd28d9)
• Add clear() method to repeated fields in Python. (0324f39)
• Register Scalar/MessageMapContainerTypes as virtual subclasses of (9a0b591)
• Fix python codegen crash when C++ features are used. (308aaf4)
• Add more detail to the comment for GetMessageClassesForFiles (9befb58)
• Add constructing unpack routine to Python Protobuf Any API. (fb78c09)
• Implement typing for proto Timestamp/Duration assignments. (0e3326b)

PHP

• Deprecate Descriptor Label. As an alternative, add helper methods for checking whether a field is required or repeated. (d82de8f)
• Feat(php): improve return typehint when repeatedfield (#​11734) (e04fe69)

PHP C-Extension

• Automated rollback of commit f9863df. (#​21355) (a59988c)
• Deprecate Descriptor Label. As an alternative, add helper methods for checking whether a field is required or repeated. (d82de8f)
• Ruby: Allow to get a file descriptor by a file name (#​20287) (c398592)
• Feat(php): improve return typehint when repeatedfield (#​11734) (e04fe69)
• See also UPB changes below, which may affect PHP C-Extension.

Ruby

• Fix silent failure of rb_test rules to run test (#​21733) (0cf5489)
• Ruby | Add support for a protobuf debug build (#​21060) (59e1f0f)
• Ruby | Support installing the gem via git and some other small build tweaks (#​21061) (d3560e7)
• Deprecate Descriptor Label. As an alternative, add helper methods for checking whether a field is required or repeated. (d82de8f)
• [Ruby]Implement #to_hash for message classes (#​20866) (5596f6d)
• Drop Ruby 3.0 (5de7c80)
• Fixes #​18726 by backslash escaping descriptor data containing # if the hashmark appears immediately before any of $, {, or @. (fffa3da)
• Ruby: Allow to get a file descriptor by a file name (#​20287) (c398592)
• Ruby: fix bug in Map.hash (b968d0d)

Ruby C-Extension

• Ruby | Add support for a protobuf debug build (#​21060) (59e1f0f)
• Deprecate Descriptor Label. As an alternative, add helper methods for checking whether a field is required or repeated. (d82de8f)
• Ruby: Allow to get a file descriptor by a file name (#​20287) (c398592)
• Ruby: fix bug in Map.hash (b968d0d)
• See also UPB changes below, which may affect Ruby C-Extension.

UPB (Python/PHP/Ruby C-Extension)

• Fixed LTO-only linker error in upb linker arrays. (3434a21)
• Deprecate Descriptor Label. As an alternative, add helper methods for checking whether a field is required or repeated. (d82de8f)
• Add upb_Map_GetMutable API to upb (dd5bf5e)
• Fix upb to escape DefinitelyNeedsEscape (like " and ') for bytes field (b234305)
• Upb: delete functions in map_gencode_util. They're unused after the Map iterator API change. (f398807)
• Upb: Update _upb_map_next signature to return a boolean and remove the _nextmutable Map iterator API. (e4cdf44)
• Change upb C generated map iteration function to not hand out MapEntry pointers. (3a3d697)
• Ruby: Allow to get a file descriptor by a file name (#​20287) (c398592)
• Expose the upb_ByteSize function to upb clients. Note that the current naive implementation is no more efficient than serializing the message yourself and noting the resulting size. (121fdaa)
• Move upb minitable code generator into protoc (dce6b0f)
• Tolerate message set extensions encoded as normal deliminited submessages (c63fd56)
• Automated rollback of commit 6bde8c4. (8ef81fb)
• Fix UPB fast table build. (46f9e29)

Other

• Patch rules_ruby to apply neverlink = True to the jars rule (#​21416) ([#​21505](https://redirect.github.com/p